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(54) Method and apparatus for image encoding 

(57) A shape adaptive wavelet transform is per- 
formed on a digitized image signal representing an 
image. First, a shape information is obtained about the 
image, and the shape information is applied to a shape 
adaptive wavelet filter. The shape adaptive wavelet filter 
detects a starting point and an ending point of the 
image. The digitized image signal is divided into low-fre- 
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quency component and high-frequency component. 
Then the each frequency component is sampled, using 
the shape information. The shape adaptive wavelet filter 
then generates converted shape information indicating 
the shape for each sampled frequency component. 
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Description 

FIELD OF THE INVENTION 

5 The present invention relates to a method and apparatus for image encoding. And more specifically, the method 

and apparatus employing the wavelet transform for image encoding. 

BACKGROUND OF THE INVENTION 

10 Image compression methods using the discrete cosine transform have been standardized by the Joint Photo- 
graphic Experts Group (JPEG) and Moving Picture Experts Group (MPEG). 

Recently, however, there has been much interested in alternative image compression methods that use the wavelet 
transform technique. The wavelet transform iteratively separates low spatial frequencies from high spatial frequencies, 
to produce a multiresolution representation of an image. For many images, the wavelet transform offers the possibility 
15 of a higher compression ratio than the discrete cosine transform. 

For example, Stephane Mallat, "A Theory for Multiresolution Signal Decomposition: The Wavelet Representation", 
IEEE Trans. PAMI, Vol. 1 1 , Nov. 7, July 1989. pp 674-693 discloses a method for wavelet transform for images. 

A conventional multi-level multi -dimensional wavelet filter for wavelet transform is constructed by connecting a plu- 
rality of base wavelet transformer in cascade. The base wavelet transformer performs single-level one-dimensional 
20 wavelet transform. The base wavelet transformer is comprised of a single-level one-dimensional wavelet filter. 

A problem is that the conventional-art method works only with rectangular images. If an image is not rectangular, 
the image must be embedded in a rectangle, and the non-image parts of the rectangle must be filled in with, for exam- 
ple, the average value of the image signal, or with signal values copied form the border of the image. 

However, the compression efficiency of the resulting rectangular image tends to be impaired. Because a large gap 
25 may occur between the image and the filled-in area, and more pixels than the original image area need to be encoded 
and transmitted. Which will cost lots of bits to encode it. 

SUMMARY OF THE INVENTION 

30 Accordingly, it is an object of the present invention to execute a wavelet transform on an inputted image with an arbi- 
trary shape. 

It is another object of the present invention to provide a wavelet transform on an inputted image with higher coding 
efficiency. 

According to a first aspect of the present invention, a shape adaptive wavelet transform is executed on inputted 
35 images. First, a shape information of the image is obtained. The shape information contains at least a starting point and 
an ending point, of consequent image area of the image. Then, the image is filtered and divided into a plurality of res- 
olutions. Each resolution is sub-sampled to obtain sub-sampled signal. While the shape information is converted to the 
new shape information, which indicates positions at which the sub-sampled image signal is exist. Thereby, a one- 
dimensional wavelet transform on each line of the image is performed. 
40 According to a second aspect of the present invention, an N-level shape adaptive wavelet transform is executed on 
inputted images. To the wavelet transformer of the invention, the image signal and shape information thereof are input- 
ted. The first stage wavelet transformer generates first and second sampled signal and feed them into next stages. The 
second and third stages execute wavelet transform on the first and second sampled signal, respectively. 

45 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG.1 illustrates a general structure of the present invention. 

FIG.2 shows a first embodiment of the shape adaptive wavelet transformer of the present invention. 
FIG.3 shows a detailed block diagram of the shape adaptive wavelet filter in Fig. 2. 
so FIG.4 shows a process of the shape adaptive wavelet transform of the present invention. 

FIG.5 shows a second embodiment of the shape adaptive wavelet transformer of the present invention. 

DESCRIPTION OF THE PREFERED EMBODIMENT 

55 Embodiments of the present invention will now be described with reference to the attached drawings. 

The shape adaptive wavelet transformer receives a digitized signal representing a rectangular still picture, or a sin- 
gle rectangular frame in a moving picture, or the difference between two rectangular frames in a moving picture. Typi- 
cally, as shown in Fig. 1 , an image is indicated in such rectangular still picture or picture frame. The embodiments of the 
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present invention carry out a wavelet transform on such images with arbitrary shapes. 

According to the first embodiment of the present invention, image signal s1 1 and shape information s12 of the 
image signal are generated from the picture or picture frame. The image signal s1 1 gives the value of each pixel in the 
picture frame. In the embodiment, the image signals s11 can be raster-scan data of the picture or picture frame, 
s Namely, the image signal s1 1 is one-dimensional. The image signal s1 1 is inputted to a one-dimensional shape adap- 
tive wavelet transformer 10. 

The shape information s12 describes the shape of the image. In other words, the shape information s12 indicates 
which part of the image signal s1 1 belongs to the image. The shape information comprises, for example, a rectangular 
bit mask, or a run-length encoding of such a bit mask. A shape information generator 5 generates such shape informa- 
10 tion s12 and applies it to the shape adaptive wavelet transformer 10. 

First, a block diagram of one embodiment of the present invention is shown in Fig. 2. The first embodiment is a one- 
dimensional shape adaptive wavelet transformer 10 having a shape adaptive wavelet filter 11. To the shape adaptive 
wavelet filter 1 1 , image signal si 1 and shape information s12 of the image signal are inputted. 

The shape adaptive wavelet transformer 10 further has a first memory 121, a second memory 122, and a third 
75 memory 123. These memories are connected to the shape adaptive wavelet filter 1 1 . 

Fig. 3 shows a detailed block diagram of the shape adaptive wavelet filter 11 . As shown in Fig. 2. the input image 
signal s1 1 and the shape information s1 2 are applied to a image area detector 21 . The image area detector 21 detects 
a consequent image area among the inputted image signal s1 1 . More specifically, the image area detector 21 deter- 
mines a starling point S1 and an ending point Si, where i is a positive integer, of the image. The image area detector 
20 21 then determines the area between the starting point Si and the ending point Sj as a consequent image area. 

The starting point Si and the ending point Sj mean locations from an anchor point. Typically, for example, the anchor 
point can be the upper-leftmost point of an inputted image frame. Or, in this embodiment, since the image signal s1 1 is 
one-dimensional, the anchor point can be determined as the leftmost point of the inputted image signal. The starting 
point Si and the ending point Sj can be indicated as a number of pixels from the anchor point. 
25 The image area detector 21 then applies the detected starting point Si and the ending point Sj to a shape converter 
22. The image area detector 21 further outputs the image signal s1 1 to a low-pass filter 231 and a high-pass filter 232. 

The low-pass filter 231 receives the image signal si 1 of a consequent image area from the image area detector 
21. Then, the low-pass filter 231 filters the inputted signal and outputs the low-frequency component thereof (s13) by 
the following equation (1 ), where h(k) means a filter coefficient of the low-pass filter 231 : 

30 

ml 

S ul (i) = Z St (i + k) h(k) •••(!) 
k=-nl 



On the other hand, the high-pass filter 232 filters the inputted image signal s1 1 and outputs the high-frequency 
component thereof (sl4) by the following equation (2), where g(k) means a filter coefficient of the high-pass filter 232: 

40 

mh 

W t+1 (i) = Z St (i + k) g(k) • • • (2) 
45 k=-nh 



The filtered low-frequency component s13 is fed to the sub-sampling circuit 241, while the filtered high-frequency 
component s14 is fed to the sub-sampling circuit 242. As the result, each of the two output signals s13 and s14 each 
so have half the resolution of the input signal s1 1 . 

The shape converter 22 instructs the sub-sampling circuit 241 to generate a first sampling signal s16. The shape 
converter 22 also instructs the sub-sampling circuit 242 to generate a second sampling signal s1 7. 

Upon receiving the instruction; the sub-sampling circuit 241 generates the first sampling signal s16. The first sam- 
pling signal s16 is generated by outputting the pixels located in the "even" position refering to the anchor point. Then 
55 the first sampling signal s16 is applied to the second memory 122. 

The second sampling signal s17 is generated by outputting the pixels having an "odd" position refering to the 
anchor point. Then the second sampling signal s1 7 is applied to the third memory 123. 

The first sampling signal s16 is stored in the second memory 122. The start address to which the first sampling 
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result is stored corresponds to S1 / 2. The second sampling result is stored in the third memory 123. The start address 
to which the second sampling signal s1 7 is stored corresponds to (S1 -1 ) / 2. . 

For example, suppose that the inputted image signal s1 1 has consequent image area with starting point "9" and 
ending point "16", the sub-sampling circuit 241 outputs pixels positioned at 10, 12, 14, and 16 as the first sampling sig- 
5 nal s1 6. These pixels are stored in the second memory 1 22, at the addresses correspond to 5, 6, 7, and 8, respectively. 
While the sub-sampling circuit 242 outputs pixels positioned at 9, 1 1 , 1 3, and 1 5 as the second sampling signal s1 7. 
These pixels are stored in the third memory 123, at the addresses correspond to 4, 5, 6, and 7, respectively. 

As explained above, it should be understood that the first sampling signal s16 contains pixels having an "even" 
position of low-frequency component of the inputted image signal s1 1 . On the other hand, the second sampling signal 
10 s1 7 contains pixels having an "odd" position of high-frequency component of the inputted image signal s1 1 . 

The shape converter 22 further outputs converted shape information si 8 and sl9 to the first memory 121 . The con- 
verted shape information indicates output positions of the low-frequency component and the high-frequency compo- 
nent, respectively. 

The above explained function is explained again with reference to Fig. 4. In Fig. 4, a digitized picture frame 20 
15 which contains 4 lines is shown. Each line contains 10 pixels. In Fig. 4, pixels inside the image are digitized and indi- 
cated as a.b.c, .... k. The remaining six pixels, that are at the outside of the image, are indicated as 0. 

Now, suppose that Line 1 of the digitized picture frame 20 is inputted to the shape adaptive wavelet transformer 10. 
In Line 1 of the digitized picture frame 20, an image exists on, from fourth to seventh pixel. Therefore, the generated 
image signal s11 is [0, 0, 0, a. b, c, d, 0, 0, 0]. While generated shape information S12 is [0, 0, 0, 1,1.1, 1, 0, 0, 0]. 
20 When the shape information s1 2 is inputted to the image area detector 21 , it detects the fourth pixel as the starting point 
Si, and the seventh pixel as the ending point Sj. These starting point Si and ending point Sj is fed to the shape converter 
22. 

The image signal s1 1 is applied to both the low-pass filter 231 and the high-pass filter 232. After the filtering proc- 
ess, the low-frequency component s13 becomes [0. 0, 0, a', b\ c\ d\ 0. 0, 0], while the high-frequency component s14 
25 becomes [0, 0, 0, a", b", c", d", 0, 0, 0]. These low-frequency component s13 and the high-frequency component s14 
are applied to the sub-sampling circuit 241 and 242, respectively. 

The sub-sampling circuit 241 outputs pixels located at "even" position, while the sub-sampling circuit 242 outputs 
pixels located at "odd" position. As the result, the first sampling signal s16 is [0, a\ c\ 0. 0], while the second sampling 
signal s17is[0, 0, b". d", 0]. 

30 The shape converter 22 generates converted shape information s18 and s19. The converted shape information 
s18 and s1 9 describes the shape of the first and the second sampling signal s16 and s1 7, respectively. 

According to the first embodiment, images with arbitrary shapes can be wavelet transformed with the shape main- 
tained. The embodiment provides more efficient transform than the conventional-art method, since the invention of this 
embodiment transforms only pixels belong to the image. Thus, the embodiment reduces transform calculation. 

35 When the input signal represents a two-dimensional image, wavelet filtering is performed separately on each 
dimension. The second embodiment of the present invention is for performing a two-level shape adaptive wavelet trans- 
form on a two-dimensional image signal. The block diagram of the second embodiment is shown in Fig. 5. 

As shown in Fig. 5, wavelet transformer of the second embodiment has three stages 1 , 2, and 3. A configuration of 
each stage is essentially the same to that of the first embodiment, so the detailed explanation is omitted. 

40 First, the input image signal s1 1 and the shape information si 2 are inputted to the first stage 1 . The stage 1 per- 
forms shape adaptive wavelet transform in the same manner as the first embodiment. 

The shape adaptive wavelet filter 11 of the stage 1 outputs the first sampling signal s16, second sampling signal 
s1 7, converted shape information s18 and s1 9. In the second embodiment, all the lines of the image are wavelet trans- 
formed and the resultant data are stored in the memory 121 , 122, and 123. 

45 After all lines are wavelet transformed, the memory 1 21 of the first stage 1 applies the converted shape information 
s1 8 to the second stage 2, and the converted shape information s1 9 to the third stage 3. Further, the first sampling sig- 
nal s16 is applied to the second stage 2 from the memory 122, and the second sampling signal s17 is applied to the 
third stage 3 from the memory 123. 

Namely, the stage 1 performs, for example, a single-level one-dimensional wavelet transform on each horizontal 

so line of the input image. Then, the pixels having an "even" absolute position of the low-frequency component are fed to 
the second stage 2. While, the pixels having an "odd" absolute position of the high-frequency component are fed to the 
third stage 3. In addition, the converted shape information s18, which indicates positions of first sampling signal s16. is 
also fed to the second stage 2. Further, the converted shape information s19, which indicates positions of second sam- 
pling signal s1 7, is also fed to the third stage 3. 

55 Thus, the second stage 2 and the third stage 3 performs a single-level one-dimensional wavelet transform on each 
vertical line of half the resolution of the image signal s1 1 . Then, the second stage and the third stage output the trans- 
formed results, respectively. 

According to the second embodiment, two-dimensional image is first transformed horizontally, then transformed 
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vertically, or vice versa. Such multi -dimensional wavelet transform is effectively performed. 

Other variations are also possible in the preceding embodiments. For example, the "even" and the "odd" position 
can be alternative each other. Namely, the sub-sampling circuit 241 can output pixels having an "odd" absolute position 
and the sub-sampling circuit 242 can output pixels having an "even" absolute position. 
5 A plurality of wavelet transformer of Fig. 5 can be disposed in parallel. As a result, the plurality of lines of an image 

can be wavelet transformed simultaneously, thus the total coding time is reduced. Further, the low-pass filter 231 and 
the high-pass filter 232 can employ other equations. 

The subject-matter of the application could be summarized in general as follows. 

A shape adaptive wavelet transform is performed on a digitized image signal representing an image. First, a shape 
10 information is obtained about the image, and the shape information is applied to a shape adaptive wavelet filter. The 
shape adaptive wavelet filter detects a starting point and an ending point of the image. The digitized image signal is 
divided into low-frequency component and high-frequency component. Then the each frequency component is sam- 
pled, using the shape information. The shape adaptive wavelet filter then generates converted shape information indi- 
cating the shape for each sampled frequency component. 

15 

Claims 

1 . A method of encoding a digitized image, comprising the steps of: 

20 obtaining the shape information of the image; 

dividing the image into a plurality of resolutions; 
sampling each of the plurality of resolutions; 

generating converted shape information according to each of the resolutions, thereby performing a one-dimen- 
sional wavelet transform on each line of the image, using the shape information. 

25 

2. The method of claim 1 , the shape information obtaining step having first detecting step for detecting a starting point 
of the image, and second detecting step for detecting an ending point of the image. 

3. The method of claim 2, the first and the second detecting step detects the starting point and the ending point of the 
so consequent image area, respectively. 

4. An apparatus for encoding a digitized image, comprising: 

a shape information generator (5) for generating a shape information of the image; 
35 a filter means (231 ,232) for obtaining a plurality of resolutions of the image; 

a shape converter (22) for generating a converted shape information according to the each of resolutions, and; 
a sampling means (241 ,242) for sampling each of the plurality of resolutions. 

5. The apparatus of claim 4, further comprises an image area detector (21) for detecting an consequent image area, 
40 by detecting a starting point and an ending point of the image. 

6. The apparatus of claim 4, the filter means (231 ,232) dividing the image into a plurality of frequency components. 

7. The apparatus of daim 6, the sampling means (241 ,242) samples comprises a plurality of sampling circuits, each 
45 of the sampling circuits samples the output of the plurality of the filtering means. 
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(54) Method and apparatus for image encoding 

(57) A shape adaptive wavelet transform is per- 
formed on a digitized image signal representing an 
image. First, a shape information is obtained about the 
image, and the shape information is applied to a shape 
adaptive wavelet filter. The shape adaptive wavelet filter 
detects a starting point and an ending point of the 
image. The digitized image signal is divided into low-fre- 



quency component and high-frequency component. 
Then the each frequency component is sampled, using 
the shape information. The shape adaptive wavelet filter 
then generates converted shape information indicating 
the shape for each sampled frequency component. 
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